
end. ^Introduction.; November 2005 Pat Application 10/089,369 

-1 Of 5- 

Alfred Schurmann 

Patent Application No.: 10/089^69 | Filing Date: 03/28/2002 | Examiner: Peter Coughlan | Art Unit 2 129 

Date: November 07, 2005 

Amendments to section „1. Introduction 66 of the specification, in response to the 

Examination Report dated 9/22/2005 

The changes to the previous versions are marked as follows: (i) the deleted text is shown by strike-through 
except that double brackets [[ ]] placed before and after the deleted text are used if the deleted text has 5 or fewer 
characters, (ii) new text is underlined. 

1. Introduction FIELD OF THE INVENTION 



The present invention relates to methods for establishing emotions, such as contentment iov. dissatis- 
faction, grief liking, love, dislike. hate, revenge, depression, sadness, fear, envy, jealousy, shame and feeling guilt, 
in robots, agent systems and entertainment software. The emotional importance of objects and situations for a 
robot or agent is described. 

DESCRIPTION OF THE RELATED ART 



Experts in robots and agent systems are concerned with implementation of emotions in robots/agents 
Computer sci e nti s t ar e conc e rn e d with representation of e motions in e l e ctronic d e vic e s since sev e ral years. 
because thev: 

(a) concluded that without emotions a robot/agent can be neither intelligent nor autonomous, e.g. M Minski said 
that „the question is not whether intelligent machin es can have any emotions, but whether machines can be 
intelligent without any emotions" (in The Society of the Mind: Simon and Schuster: New York. 1986). and 
wanted establish emotions in a robot/agent in such a way that it would handle intelligent and autonomous: 

(b> wanted to make robots more userfriendly or to have emotional virtual persons in entertainment or advertising 
software: 

(c> attempted to recognize and measure emotions of a man. 

Problem (a) is not solved until now, although there were attempts to get motivated robots/agents: examples: 
(i) Agent in I know the following papers (patents) which concern th e representation of e motions in el e ctronic 
devi<*es[[ : ]] Padgham & Taylor [PTA] (1997) [[ , ]] - it can be used only as a tov. Robots in (in T. Skibata & K. 
Qhkawa &K. Tanie ..Spontaneous Behavior of Robots for Cooperation - Emotionally Intelligent Robot System". 
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ICRA'96. Proceed. IEEE 1996. and in (m) M. S. El-Nasr & M. Skubic .A Fuzzy Emotional Agent for Decision- 
Making in a Mobile Robot". IEEE, p. 135 - 140. 1998. may be treated merely as a first step towards building an 
emotional agent. Motivated agent system in (iv) A, Schurmann fAgl], 1998, and [AS2]„, 1998, may be used in 
not complex situations where not complex activities are needed. 

A key problem in developing intelligent and autonomous robots/agents is to judge how good or bad is a 
recognized object or situation for the robot/agent, at present. An attempt to solve this problem is to associate a 
vector of attributes, such as hope, frustration, love, hate, jov. despair, fear; these attributes are weighted when 
calculating how good or bad is the object for the robot/agent. This is a rough judgement method = the used 
emotions are too general, and the current intensities of desires and needs of the robot/agent are not taken into 
account. Such judgement of objects and situations is not intelligent enough in many cases. Therefore, also the 
behavior of a robot/agent based on such object judgement is not intelligent in many situations, e.g. when a robot 
needs energy supply and an urgent situation appeared. 

The judgement method given in El-Nasr & at all. (w\ is even less satisfactory than the method mentioned 
above. The robot described there has only emotions anger, pain and fear. To an recognized event or object is 
associated a desirability attribute measuring how desirable is this event or object with regard to goals. Using this 
desirability and the priorities associated to goals, the priority of emotion with regard to a goal is calculated; then, 
using a rather large number of emotional rules, the activity to be executed is chosen. Because of associating a 
desirability attribute with regard to goals, this method of object judgement is a very rough one and has very 
restricted application. 

In my said in (iv) papers, an agent system has desires with respect to needs of the agent; the above 
mentioned basic emotions (hope, frustration, love, etc.) are not considered. In these papers, to object and 
situations are associated desire attributes with regard to the n eeds of the agent; such desire attribute shows how 
the object or situation increase or decrease a desire intensity with regard to a need. These desire attributes enable 
acceptable judgement of recognized object and situations, if we accept that the agent has rather restricted 
intelligence and autonomy. Mv papers in (iv) do not solve the problem (a), if we want an intelligent and 
autonomous robot/agent. 

Problem (b) was investigated in: (v) Mi^ok awa & T. Iwata-Shi & Shizuoka-ken ^Control system and 
method for controlling object using emotions and personality generated in the object". Eur. Pat EP 0978790A1. 



Febr.. 09 2000. (vi) Breese & Bail [BRD] (1999), £yn) Brush & at all [BDL] (1998), £ym) Clynes [CLY] (1996), 
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(ix) Kawamoto & Omura [KAO] (1994), £x) Knight & at all [KMS] (1997), (m) Skelly [SKE] (2000), (>Qi) Tow 
[TOW] (2000) , (xiii) K.Lee ..Integration of Various Emotion Eliciting Factors for Life-like Agents". ACM, p. 
1 55 - 158. 1999. and (xiv) R. Nakatsu & J. Nicholson & N. Tosa ^Emotion Recognition and Its Application to 
Computer Agents with Spontaneous Interactive Capabilities' 4 . EBAA'99, Workshop on Emotion-Based Agent 
Architectures. Seattle USA. May 1999 . These papers/patents do not consider the problem (aV 

Problem (c) is not solved in a satisfactory wav - no published method recognizes or measures emotions 
reliable on basis of facial expression, voice prosody or motion behavior, e.g. the methods given in (v). (vi) and 

In all said papers/patents, except my papers, are considered only the so called basic emotions (happiness, 
sadness, love, hate, fear, acknowledgement, expectation, aggressiveness, expectation), which can represent only 
general emotion states of a robot/agent or a virtual person. In my said papers these emotions are not considered; 
the motivation of a robot/agent to execute an activity is there determined bv means of desires with regard to 
needs of the robot/agent. I n the s e papers, emotions ore modelled in other way than b e low and not sufficient. 

1. BRIEF SUMMERY OF THE INVENTION 

In mv invention, satisfactions and desires with regard to needs of a robot/agent or a virtual person (denoted 
bv Pd) are the primary emotions. The emotions contentment, joy, dissatisfaction, anger, grief, sadness, liking, 
love, dislike, hate, retaliation and revenge, frustration, depression, envy, jealousy, shame and feeling guilt are 
secondary emotions; the intensities of these secondary emotions are obtained bv short procedures or rules from 
intensities of satisfactions and desires with regard to the needs of Pd. In this way, the emotional states of Pd and 
the development of emotions are described more precisely than in the methods given in the papers/patents 
(i) (xiv) mentioned in the above paragraph. 

The established intensities of satisfaction and desire of Pd with regard to a need enable to connect a stimulus 
pattern, with regard to th ^t need, with object and situation mod els. Such stimulus pattern with regard to a need 
describes the expected alterations of satisfaction and desire intensities with regard to said need, in a time period, 
when Pd has recognized an object or a situation as an instantiation of said object or situation model containing 
this stimulus pattern. By stimulus pat terns, connected with an object or a situation, and current intensities of 
satisfactions and desires, the current stimulus intensity of said object or situation is calculated. This stimulus 




Amend. .Untroduction.; November 2005 



-4 Of 5- 



Pat Application 10/089,369 



intensity measures, satisfactory, how good or bad is said object or situation for Pd at present. Because stimulus 
patterns describe much more precisely how emotion intensities change, than said, in the above paragraph, vector 
of attributes (such as hope, frustration, love, hate. joy....l the said stimulus intensity of an object or situation 
measures more intelligently the importance of this object or situation for Pd m at present: bv stimulus intensity of a 
situation, a robot can judge which of two situations is more urgent, at present. Additionally, said stimulus pattern 
with regard to a need, enables to calculate the expected intensities of satisfaction and desire with regard to the 
need, at present and in the future, when Pd has recognized an object or a situation. 

Due to said current stimulus intensity of a situation, an intelligent motivation of Pd to execute an activity 
can be determined (however, such motivation is not considered in this description^ and in this way solve the said 
problem (a). 

The representation of e motions given in this d es cription is based on notions (desire s and satisfaction, stimuli) 
introduc e d in my papers [AS1] (199 8 ) and [AS2] (199 8 ). The representation of e motion state s , given below, 
enabl e s very good simulation of e motions: — a) In Int e rnet and entertainment software one may repres e nt virtual 
p e opl e who behav e emotional, according to th e changing surrounding, and understand e motions of other virtual 
p e opl e , e .g. a virtual man in Internet who expr e ss e s emotions when h e shows war e . — b) In agent s ystem s which 
handl e and communicate with peopl e . Such ag e nt s yst e m could not only expr e s s emotion s according to actual 
s ituations but also understand emotions of p e opl e in surroundings of th e agent system. These applications can be 
made if also other problems are solved, e.g. perception which can id e ntify e motions, connection of behavior s with 
emotion states. 

In paragraphs 3 7 below are given short procedures and rules which determine (and show the 

development of) the intensities of the following emotions using said intensities of satisfactions and desires with 
regard to needs of Pd: In this paper, th e following stimulus and emotion stat e s are formal de s crib e d: 
the s timuli of OS A, wh e r e OSA d e not es an obj e ct, a s ituation or an activity; 

- contentment, joy, happiness, dissatisfaction, annoyance, anger, grief, sadness, pain and suffering with regard to a 




positive emotions feelings (liking, affection, love) and negative emotions f e elings (dislike, anger) to/for an 

object, a situation or an activity [[ OSA ]] ; 
contentment satisfaction and joy when a [[goal ( ]] goal situation [[ ) ]] is achieved; dissatisfaction, anger and 

disappointment when a goal situation is not achieved; 




need of Pd : 
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- retaliation and revenge on an object, hate to an object; 

- frustration, depression [[ , ]] and sadness [[ , ]] with regard to a person, an object or a goal; 
r^envy [[ , ] jat a success or a property of a person or an other robot/agent; 

z. jealousy [[ , ]] and shame ; and 

^.feeling guilt with regard to a living o b ject, a robot/agent or a group of persons or robot/agents, when/V/ has 
made damage to them or violated some norms or rules . 
The intensities of some of these emotions, determined according to my invention, can be used to control and 
to measure the efficiency of the robot/agent Pd as follows: 

- The intensity of contentment, joy, happiness, dissatisfaction, annoyanc e, anger, grief sadness, pain and suffering 

with re g ard to a need, b t of Pd measures how g ood or ba d Pd has realized the need b\ if b denotes the need 
..achieve goal situation SMzT. then this intens ity measures how good or bad Pd has realized the achieving of 
the goal SMz: 

- The intensity of positive emotion (or negative emotion) towards an object or a situation measures how useful 

for how great obstacle, respectively) has been this object or situation for Pd: 
-The intensity of frustration with regard to a need shows how bad Pd has been able to realize this need: 
-The intensity of fear measures the un-abilitv of P d to cope with a situation or to achieve its goal, when executing 

an activity; 

The intensity of shame measures how strong Pd has violated some norms or rules. 

The invention is also a good solution of the, said in the paragraph above, problem (b). because it enables 

- to get more exactly the emotional personality of an agent or virtual person, than the other existing methods, and 

- to show h ow emotions of a virtual person/aggnt develop. 

Because the invention differs from other existing methods for e stablishin g emotions in a robot/agent, the 
following description is very detailed and contains many examples. The function notation, e.g. beffPd.b.t). 
zfulfPdbJk abhas(P<LOSA) etc.. is used only because of its good legibility. I could use also the notation bef M u . . 
zfulpAh t , abhasp jns, etc. to represent emotion intensities, however this notation is not easily legible. 

DETAILED DESCRIPTION OF THE INVENTION 



2. Representation of Desires and Patterns of Stimuli 



